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Abstract. We study a rational version of the double affine Hecke algebra associated to the 
nonreduced affine root system of type (C^ , Cn). A certain representation in terms of difference- 
reflection operators naturally leads to the definition of nonsymmetric versions of the multivari- 
able Wilson polynomials. Using the degenerate Hecke algebra we derive several properties, such 
as orthogonality relations and quadratic norms, for the nonsymmetric and symmetric multivari- 
able Wilson polynomials 



1. Introduction 

The Macdonald theory of multivariable orthogonal polynomials associated to root systems can 
be understood using a specific representation of Cherednik's double affine Hecke algebra (DAHA) in 
terms of q-difference- reflection operators, see e.g. Cherednik [5] and Macdonald [H]. Koornwinder 
polynomials [T3] generalize the Macdonald polynomials associated to classical root systems. The 
algebraic structure underlying the Koornwinder polynomials is Sahi's DAHA associated to the 
nonreduced affine root system of type (C^, C„), see Noumi [IB], Sahi [IS], [TH], and Stokman [2"U] , 
The Koornwinder polynomials depend, besides the base q, on five parameters, corresponding to 
the number of VF-orbits in the affine root system of type (C^, C n ) with corresponding affine Weyl 
group W. Many families of multivariable orthogonal polynomials can be obtained as limits of the 
Koornwinder polynomials, see e.g. |4] and [21]. Several of these families have been associated in 
the literature to degenerate versions of double affine Hecke algebras. For instance, the Heckman- 
Opdam polynomials [H] are naturally associated to a trigonometric degenerate DAHA [17] , 

In this paper we study an algebra 7i which is a rational degeneration of the DAHA of type 
(Cn,C n ), and we show that multivariable Wilson polynomials are associated to Tt in a natural 
way. Multivariable Wilson polynomials are limits of the Koornwinder polynomials (for q — > 1) 
depending on five limiting parameters, see Van Diejen [3],[4|. The one- variable Wilson polynomials 
|22| are the most general orthogonal polynomials of hypergeometric type, i.e. all hypergeometric 
orthogonal polynomials, for instance, the Jacobi polynomials, can be obtained as a limit of the one- 
variable Wilson polynomials. It may be expected that the multivariable Wilson polynomials play 
a similar role in the theory of orthogonal polynomials of hypergeometric type associated to root 
systems. Let us show that Wilson polynomials formally generalize the BC-type Heckman-Opdam 
polynomials. Under suitable conditions on the parameters the multivariable Wilson polynomials 
are orthogonal on (iR + ) n with respect to the weight function 

tt T(t±Xj±x k ) i r r(q ± Xj)r(b ± XjjTjc ± Xj)T(d ± xj) 

Here we use the notation T(a ± 0) = T{a + (3)T(a — (3). The weight function A+(x) may be con- 
sidered as a generalization of the weight function for the -BC-type Heckman-Opdam polynomials. 
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Indeed, divide by a factor 



J] T(a + c + (j - l)t)r(6 + c + (j - i)*)r(a + d + (j - l)t)r(6 + d + (j - l)t), 

3=1 



and substitute 



a = 6 = 



a + 1 



/?+ 1 



17, d = 



/? + 1 



2 ' 2 ' "" ~ 2 

then after applying Stirling's formula we find that in the limit 7 — * 00 



17, Xj = lJy/Vj, 



A+(x) 



l<i<fe<n j=l 



2/1, ...,!!„£ (0, 1), 



and A + (x) vanishes exponentially if yj > 1 for any j. 

The rational DAHA Ti that we study has a faithful representation in terms of difference- 
reflection operators, much like the representation of the trigonometric DAHA from [Tj. Non- 
symmetric versions of the multivariable Wilson polynomials then appear in the representation 
theory of Ti as the polynomial eigenfunctions of the analogues of the Chcrcdnik operators. Meth- 
ods from double afhne Hecke algebras, see e.g. [2J, [H], can now be used to obtain properties of 
the nonsymmetric multivariable Wilson polynomials, such as orthogonality relations and a dual- 
ity property. The rank one version of the algebra Ti and the corresponding one-variable Wilson 
polynomials have been studied in .10]. Let us remark that a four-parameter subfamily of the 
(symmetric) multivariable Wilson polynomials have been obtained by Zhang [23j in the context 
of degenerate Hecke algebras as the Harish-Chandra transform of the £?C-type Heckman-Opdam 
polynomials. 

The algebra Ti has appeared earlier in the literature; it is isomorphic to a rational generalized 
DAHA defined by Etingof, Gan and Oblomkov [5] . Results in [5] then imply that Ti is also closely 
related to several other algebras appearing in the literature, e.g. Ti is the spherical subalgebra of a 
certain deformed preprojective algebra by Gan and Ginzburg [9 . In this paper we obtain several 
new properties of the algebra Ti. One remarkable property is that it contains a subalgebra H that 
may be considered as a deformation of C[W] with deformed braid-relations. To be more precise, 
as an algebra H is generated by To, . . . , T n , which satisfy the following braid- type relations: 

TiTi + iTiTi + i + tTiTi + i = Ti + iTiTi + \Ti + tTi + iTi, i = 0, n — 1, 

TiT i+1 T t = T i+ iTiT i+ i, i e [l,n - 2], 

T i T j =T J T i , \i~j\>2. 

Here t is some complex parameter. For t = the above relations are the usual braid relations for 
W. Deformations like this, i.e. deformations of a group algebra C[G], G a Coxeter group, with 
deformed braid relations, have recently been studied by Etingof and Rains [7], [8]. 

The paper is organized as follows. After some preliminaries on root systems, we define in 
section [5] a subalgebra H of the trigonometric DAHA fj, and it is shown that the subalgebra H 
is a deformation of the group algebra C[W]. Then in section [3] we define the rational DAHA Ti 
as a subalgebra of f) that is generated by H and a polynomial algebra. We derive several useful 
properties of Ti, such as a PBW-theorem, and we define the analogues of Cherednik's ^-operators. 
In section |4] we study a faithful representation 7r of Ti in terms of difference-reflection operators 
on the vector space V consisting of polynomials in n variables. The nonsymmetric multivariable 
Wilson polynomials are used to describe the decomposition of V into irreducible 7r(iJ)-modules. In 
section[5]we derive several properties of the nonsymmetric Wilson polynomials. Finally, in section 
H2 we show how well-known properties of the (symmetric) multivariable Wilson polynomials can 
be obtained from the representation theory of Ti. 
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2. The degenerate affine Hecke algebra 

In this section we define an algebra H that we consider as a degenerate affine Hecke algebra of 
type C n . Throughout the paper we use the following notation: for integers m,n with m < n we 
write [to, n] for the set {to, to + 1, . . . , n}. 

2.1. The affine root system (C^,C n ). We fix an integer n > 2. Let {ej}™ =1 be the standard 
orthonormal basis for V = R" with standard inner product (-,■). Let V denote the vector space 
of affine linear transformations from V to R. We identify V with V © R<5 by writing / <G as 

f(u) = {v, u) + c5(u), ueV, 

for some v G V and c e R, where 5 : V — > R is defined by = 1 for all u e V. The inner 
product on V is extended to a bilinear form on V by 

(Ai + /j, 1 6,X 2 + H2&) = (Ai,A 2 ), Ai,A 2 eV, ft.^eR. 

We define 

a = 5 - 2ei, a, = e 4 - e l+1 (i = 1, . . . , n - 1), a„ = 2e„. 

The elements dj G V are the simple roots for the affine root system of type C n . Let W be the 
subgroup of GL(V') generated by the simple reflections s ai = Si, i = 0, . . . , n, where for (3 G V 
with (P, P) ^ the reflection sp is defined by 

sp.f = .f-(.f,[3 v )f3, /3 V 21 



(A/3)' 

for / e The group is a Coxeter group with relations sf = 1, i € [0,n], and 

SiSi+iSiSi+i = s i+ iSiS i+ iSi, z = 0, n - 1, 

SjSj+iSj = Sj+iSjSj+i, ie[l,n-2], 

SiSj=SjSi, i,je[0,n], \i-j\>2. 

The set 7^ r = Vt^ao, . . . , a n } C V is the (reduced) affine root system of type C n . The nonreduced 
affine root system of type (C^, C n ) is the root system 1Z = TZ^ U lZ r . The root systems 1Z,TI)! 
and lZ r all have W as corresponding affine Weyl group. We denote by Wo C W the (finite) Weyl 
group generated by si, . . . , s n . Note that the subgroup generated by si, . . . , s n _i is isomorphic to 
the symmetric group S n . The set S = Wo{ffli, ■ • ■ , a n } is the root system of type C n . We write 
TV^^Ti^, for the positive/negative roots in 1Z, lZ r , S, respectively, with respect to our choice 
of simple roots. In particular, 

TZ+ = £+ U {a e TZ r | a(0) > 0}. 

The co-root lattice Q v and the weight lattice P of S in V can both be identified with A = 
0" =1 Zej. We denote by A + the cone of dominant weights, i.e., A+ = 0™ =1 Z^o^i, where = 
ei + . . . + ej. There is an alternative description of the affine Weyl group W as the semidirect 
product 

W = Wo K t(A), 

where r(A), A e A, is the translation operator given by r(A)/ = / + (X,f)5 for / e V. The 
translation operator r(ej), i G [l,n], can be expressed in terms of the simple reflections by 

(2.1) r(e,) = Si • • • s„_is„s„_i • • • sis si • • • Sj_i. 



This is a reduced expression. 
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2.2. A degenerate affine Hecke algebra. Let Vc — V ® iV be the complexification of V. The 
finite Weyl group Wo acts on Vc by reflections as defined in the previous subsection. We get a 
representation of the affine Weyl group W on Vc by defining t(X)x = x — A for A G A and x £ Vc- 
Let V be the algebra consisting of polynomials on Vc, then W acts on V by (wp)(x) = p(w~ 1 x), 
in particular 

(s p)(x) =p(l- X 1 ,X2,-..,X n ), 

(sip)(x) = p(x 1 , . . .,Xi-i,x i+ i,Xi,x i+ 2, ■ . -,x n ), ie [l,n- 1], 
(s n p)(x) =p(xi, . . .,X n -i,-X n ), 

where x = (x\, . . . , x n ). We denote by V w ° the algebra consisting of polynomials p G V that are 
invariant under the action of the finite Weyl group Wo, i.e., s t p = p for i G [l,n]. The set of 
monomials {x^J-^ez^ forms a linear basis for V. Here we use the notation x^ — x^xi^ 2 ■ ■ -x^ n 
for x = (xi, . . . , x n ) and pn — (fi, e,). ft will be convenient to label this basis with elements in A. 
For this we define a bijection (f> : Z — > Z>o by 

f2m, to>0, 

<K m = i o 1 / n 

I -2m — i, to < 0. 

Now for A = Y^, ^i e i £ Awe denote 

n 

0(A) = £>(Ai) Ci . 

i=l 

Then the set {x^ a )}a<ea is a linear basis for V. 

Let k : 7\L r — > C be a multiplicity function on 7£ r , i.e., k is constant on IT-orbits in lZ r . The 
function k is uniquely determined by its values on ao,a\ and a n , so we may identify k with 
the ordered 3-tuple (ko,k\,k n ), where fc; = k(aj). Let "Px be the algebra C[Xi, . . . , X n }. If 
P( x ) — J2u c n xfl G is a polynomial, we denote by p(X) the element ^^c^X^ in "Px, where 
X^ = X^ 1 ■ ■ ■ X% n for ^ = (fi, ej). The degenerate (trigonometric) DAHA ,f)(k) associated to the 
root system lZ r is the complex associative algebra generated by W (with generators r,, i = 0, . . . , n) 
and with the cross-relations 

nP (x) - ( SlP )(x) ri = (is iP )(X) - P {xfj , »e[0,n]. 

If we say that an algebra A is generated by the algebras A' and A" (both having a unit element) 
we mean the following: 

• A ~ A' (g> A" as vector spaces, 

• for a' G A' and a" G ^4" the maps a' i— > a'®l and a" i— > l®a" are algebra homomorphisms, 

• (a' <g> 1)(1 <g> a") = a' <g> a", for a' G A', a" G A". 

Moreover, we will write a' a" instead of a' <g> a". 

The algebra f)(k) has a linear basis, called the Poincare-Birkhoff-Witt (PBW) basis, 

{wX+W \weW, A G A}. 

Let t : 1Z — > C be a multiplicity function on 7?., that we identify with the ordered 5-tuple 
(t(ao), t(a.o), t(ai), t(a„), t(a^)) = (to,uo,t,t n ,u n ). We assume that the function t is related to 
the multiplicity function k by 

fc = 2t + 2u , fci = i, fc„ = 2i„ + 2u n . 

We write trc r = (to, t, t n ) and t^v = (u , i, u„). We now define a subalgebra H(tn r ) of £>(k) that 
may be considered as a rational version of the affine Hecke algebra of type C n . 

Definition 2.1. The algebra H = H(tn r ) C Sj(\s) is the subalgebra generated by n, . . . , r„_i and 

= tj + i(t t -u t + ay(X)){n - i), i = 0,n. 
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Although it is not clear at this point, the algebra H is an (uq, u„)-dependent subalgebra of 
£)(k) that depends as an abstract algebra only on t-ji r = (to,t,t n ). When working in the algebra 
H we will write Ti — Ti for i e [1, n — 1], so H is the algebra generated by Ti, i G [0, n}. We also 
define the algebra H n C H to be the subalgebra generated by Tj, i £ [1, n]. This is the analogue 
of the finite Hecke algebra of type C„. 

Proposition 2.2. We have the following relations in the algebra H: 
Quadratic relations: 

Tf=tl i = 0,n, 

Tf = l, ie[l,n-l], 

Braid-type relations: 

TiT i+ iTiT i+ i + tTiT i+ i = T i+ iTiT i+ iTi + tT i+ iT i} i = 0, n — 1, 

T,T 4+1 T 4 = T i+1 TiT i+1 , i e [l,n - 2], 

T i T j =T j T i , [0,n], > 2. 

Proof. We only need to verify the relations involving To and T„, the other ones follow directly 
from the definition of the algebra _ff . For the quadratic relations we find from the definition of Tj, 
i = 0, n, and the relations in fj(k), 

[r< - l][ti -u t + at{X)][n - 1] = [(t, - - a 4 v (X))r, - 3U - Ui - ^POlh - 1] 

= -4ti(ri - 1) 

which gives 

T 2 =t 2 + ijfo -u t + at{X)][r t - 1] 

+ \[U - Ui + a^(X)]([ n - l][U -u t + a^(X)][ n - 1]) 
=*?■ 

Next we check the braid- type relation for T n . The braid- type relation for T is checked in the 
same way. Let us write 

f(y) = \{tn - u n - y), g(y) = ^(t n +u n + y), 
then it follows from the relations in $j(k) that 

T n =t n + (s n f)(X n )(r n - 1) = r n f(X n ) - g(X n ). 

Note that we also have 

f{X n )r n - X = r„_i/(X n _i) - t/2, 
g(X n )r n -i = r„_i5(X„_i) + t/2. 

Now we find in $j(k) 

T„r„_i = r„r„_i/(X„_i) - ^tr n - r„_i#(X„_i) - t/2. 

Multiplying this from the right by T n = r n f(X n ) — g(X n ) we obtain, after some calculations 

T„r„_iT„ +tT n =r n r n -ir n f(X n _i)f(X n ) - r n r n -if(X n _ 1 )g(X n ) 
^ 2 2) ~ r n-ir n g{X n -i)f(X n ) + r n - 1 g(X n _ 1 )g(X n ) 

+ \t(r n -l)[f(X n )+g(X n )}. 
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Note that f{y) + g(y) — t n . Now we multiply (12. 2j) from the right by r„_i and bring r„_i to the 
left of / and g, then we have after a few calculations 

T71 T n l T n T n — \ -\- tT n T n —\ 
'n'n—X'n 

r n -if(X n )f(X 

n — l) ^Vi— iTnXn— 1 

g(X n )f(X n ^) 

+ \^ntr n -xr n - r n f(X n )g(X n ^ 1 ) - -t n tr„_i + g(X n )g(X n - 1 ). 



By inspection, using the braid relations for r n , this is the same as (|2.2j) multiplied by r„_i from 
the left. □ 

The previous proposition shows that H can be considered as a deformation of the group algebra 
C[W], with deformed braid-relations for i = 0, n. 

In order to show that the relations from Proposition 12.21 characterize H as an algebra we 
show that H has a PBW-basis. We introduce the following notation. If u is a word in the s^'s, 
u = Sjj ■ ■ ■ Si T , then we write T u — ■ ■ ■ Tj r . 

Proposition 2.3 (PBW-property for H). For every w £ W let w be a fixed reduced expression 
for w, then the set {T^ \ w € W} is a linear basis for H . 

Proof. The set {2V | w £ W} spans H, see [TJ Theorem 2.3]. Now suppose that we have a relation 
Y1ueW c u>Tu = in H for some coefficients c„ £ C. Using the cross-relations in Sj(k), we may 
write 



Tu= f u ,w{X)w, 



where f u ,w(X) £ Vx and f UtU is nonzero. Here w < u is meant with respect to the Bruhat order 
on W. Now we have 



^ c u f U:W (X)w = 0, 



which implies, by the PBW-property for ^, that for any w £ W 

^ c u f UiW (X) = 0. 

Let wbea maximal element (in the Bruhat order) in the set {u £ W \ c u ^ 0}, then c v f v ^ v (X) = 
in Vx- But since f v v is a nonzero polynomial, it follows that c v = 0. We conclude that c u = 
for all u £W. □ 

Corollary 2.4. ^4s an algebra H is completely characterized by the relations from Proposition 



Proof. Suppose that we have a complex associative algebra V generated by Vi, i = Q, . . . , n, with 
the same relations as in Proposition 12.21 (with replaced by Vi). Then the assignments Vi i— > Ti 
extend to a surjective homomorphism %b : V — > . Now let V S V satisfy '(/'(V) = 0. By 
Theorem 2.3] the set {Vw \ w £ W} spans V. Writing V = J2 weW c w Vuj and applying ^ shows 
that ^ weW r CujT^ = 0, hence every c w is equal to zero by Proposition 12.31 This shows that ip is 
also injective. □ 

We also have the PBW-property for the finite algebra Hq . 
Corollary 2.5. The set {T^j | w £ Wq} is a linear basis for Hq. 



From Proposition 12.21 and Corollary 12.41 it is now clear that H depends as an abstract algebra 
only on the parameters to, i, t n . Naturally we also have an algebra H(tnv ) related to the reduced 
root system IZ^ which is obtained from the algebra H(tn r ) by replacing (to,t n ) by (uo,u n ). 
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3. The rational double affine Hecke algebra 

We now come to the definition of the algebra Ti(t) that may be considered as a rational degen- 
eration of Sahi's double affine Hecke algebra for type (C V ,C). This is explained in Remark 14.21 
We call this algebra the rational double affine Hecke algebra. For rank 1 this algebra is studied 
in [10]. Let us remark that Ti is not a rational Cherednik algebra as defined in [6j. We show 
in subsection 13.41 that the algebra Ti(t) is isomorphic to the rational generalized double affine 
Hecke algebra attached to an affine Dynkin diagram of type D4 as defined by Etingof, Gan and 
Oblomkov in [5]. 

Definition 3.1. The algebra Ti = Ti(t) C SjQs.) is the subalgebra generated by H(tn r ) and Vx- 

From the relations in f)(k) it follows that in Ti we have, for p e V, 
(3.1) T lP (X) - {s iP ){X)Ti = di(X;t)[( Si p)(X) -p(X)], i G [0,n], 

where 

tl-ui + aUXf 



di(X;t) 



■e[i,n-i}. 



.a t (xy 

Together with the PBW-Theorem for the algebra H this leads to the PBW-Theorem for Ti. 
Proposition 3.2 (PBW property for Ti). The sets 

{X*MT W I A e A, w g W}, {T W X*M I A € A, weW} 
form linear bases for Ti. 

Corollary 3.3. The algebra Ti is completely characterized as an algebra by the relations for H 
from Proposition ] 2. 21 the relations XiXj = XjXi for i.j G [l,Ti], and the cross relations (|3.1|) . 

We will frequently use (|3.ip with p(X) = X,, i E [l,n]. In fact, (|3.1|) can be recovered from 
these relations. We collect the identities in the following lemma. 

Lemma 3.4. In Ti the following relations hold: 
(X.-^-Tof =u 2 , 

(X n + T n ) 2 = u 2 n , 

T t XiTi = X l+ i -tT h i € [1, n - 1], 

XiTj = TjXi, i G [1, n], j £ [0, n], \i- j\ > 2, 



XiT i+ i = T i+ xXi, i G [l,n - 1]. 



We define in Ti 



T, / j - l -j -: ' / ' \ r 'J' 



then we have (Tq) 2 = Uq and (T^) 2 = u 2 ^. For i G [1, n — 1] we will sometimes denote = Tj. 
Let us introduce some convenient notations. We write for i,j G [1, n], i < j, 

Ti rri rri m m rr~\ rr\ rr\ 

i,j — ' ' ' J j—2J- j-l-Lj-2 ' ' ' 

j-l-Lj-2 ■ ■ ■ J-i+lJ-iJ-i+l ■ ■ ■ -Lj-2-Lj-l- 

This notation corresponds to the familiar notation in the symmetric group S n where Sij denotes 
the transposition i <-> j. Recall here that the elements Ti, i — 1, . . . ,n — 1, generate a subalgebra 
isomorphic to S n . We also define in Ti 

1 — < rri rri ffl rri rt~l rri rri 

^i,n — -Li-*- i+1 ' ' ' -*- n—1-*- n-*- n—1 ' ' ' -M+l -*-i j 

1 — 1 V rj~\ rri rr~y rj~\\j rri rri rri 

a i,n — ' ' ' 1 n-l 1 n J-n-1 1 ' ' J-i+lJ-i, 

1 — 1 rri /T"7 rri rri rri rri rri 

"0,i — -M-lTi-2 • • • J lJo J 1 ' ' ' J i-2-M-l, 

1 — 'V rfl rr~\ rri rf~\\J rrt rri rj~l 

^0,i — 1 i~l 1 i~2 •••JlJo J l''' J »-2 J i-li 
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for i £ [1, n]. 

We give a few useful relations in Ti. involving Tq and . 

Lemma 3.5. The following relations hold in Ti.: 

(3.2a) TqTxTqTi = T^T^ 

(3.2b) T n T n -\T n T n -\ ~ T n -iT„T n ^iT n 

(3.2c) T v X l= X 4 T v , »e[2,n] 

(3.2d) T„ V X; - X,T„ V , i G [1, n - 1] 

(3-2e) TqT% = T„ V T 

(3.2f) T V T„ = T„T V 

(3.2g) T V T„ V = T„ V T V 



1 

(3.2h) - + T + T V + S 1)n + El„ + t ]T T 1}j = 0. 

3=2 

Proof. Relations (13.2c[) -( |3".2g[ ) are obvious. For (|3.2b|) use the relations T n _iX„T n _i = X n -\ + 
tT n -i, T n X n -i = X n -iT n from Lemma 13.41 and the braid-type relations for T„; 

T n T n -i(X n + T n )T n -i = T n (X n —i + tT n _\) + T n -\T n T n -\T n + tT n -{T n — tT n T n -i 

— (X n _\ + tT n -i)T n + T n _iT n T n _iT n 

= T n -\(X n + T„)T„_iT„. 

Relation (|3.2a|) follows in the same way. In order to prove (|3.2hj) . we observe that from TiXi+\Ti = 
Xi + tTi for i G [1, n — 1], we find by backward induction 

n 

T\ ■ • ■ T„_iX„T n _i • • • T\ = X\ + 1 Tij. 

3=2 

Then ([3~2h] follows from the identities T V + T + \ = X 1 and T„ + T% = -X n . □ 

Next we show that Tt has a subalgebra isomorphic to the degenerate affine Hecke algebra 
H(t n v). 

Proposition 3.6. The subalgebra of Ti generated by TY , j = 0, ...,n, is isomorphic to H{t-Ry)> 
i.e., it is characterized by the following relations: 

Quadratic relations: 

(T?) 2 =ul i = 0,n, 

(^ V ) 2 = l, »e[l,n-l], 

Braid-type relations: 

T v T v +iT v T v +i + tT v T v +i = T v +iT v T v +iT v + iT v_ iT V i i = ,n - 1, 

Tyr^T? = T? +1 T?T? +1 , i G [1, n - 2], 

T i v T/ = T/2; v 1 i,je[0,n], |i-j|>2. 



Proof. Let £f v be the subalgebra generated by Tj V , i = 0, . . . , n. Let us first verify that the 
relations mentioned in the proposition are satisfied in H y . We only need to check the braid- type 
relations involving T V and T^ . Let us concentrate on the relations for T^ . We already know from 
Lemma T3. 5 1 that TiT^ = T^Ti for i G [1, ti — 2]. The relation involving T n _i follows from writing 
out X n X n ^i = X n ^iX n if we writ e Xn- i = T n _iX n T n _x + ^T n -i, X n = -T„ - T^, and we use 
the braid- type relation for T n and (I3.2bp . For Tq the proof is similar. 

In order to show that the H v is indeed isomorphic to H (t-^v ) it is now enough to show that 
{T^j | w G W} is a PBW-basis for H v . This is done in the same way as in Proposition ^. 31 □ 
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We now come to the following characterization of the rational DAHA Ti, which is the analogue 
of [Ml Theorem 3.4]. 

Theorem 3.7. The algebra Ti is isomorphic to the complex associative algebra V generated by 
Vq, V v ,V n , V^,V l ^V>' ,i^\,...,n- I, such that 
(i) the subalgebra generated by Vi (i = 0, . . . , n) is isomorphic to H(tn r ), 

(ii) the subalgebra generated by (i = 0, . . . ,n) is isomorphic to iJ(t-Rv) 7 

(Hi) the following compatibility relations are satisfied: 

[V o \V n }=0, [V n v ,V o ]=0, 
1 " 

(3-3) - + v + v v + r 1<n + rl„ + 1 Vx d = o, 

J=2 



where 



Vtj = VtV 2 ■ ■ • V5_2^-_i^_2 ■ • • V 2 V U j e [2, n], 
Ti,„ = V X V 2 ■ ■ • K-iKK-i • • • V 2 V U 

rl n = v x v 2 ■ ■ • K-i^k,-! • • • v 2 v x . 

The isomorphism <p : V — > Ti is given on the generators of V by 

<p(v 1 ) = t 1 , <p(vy) = Ty, 

for i € [0, n]. 

We prove the theorem in the next subsection. 

3.1. Proof of Theorem 13.71 First note that <p preserves the defining relations for V, and ip 
maps generators of V to generators of Ti, hence ip is a surjective algebra homomorphism. In order 
to prove that ip is also injective, we show that we can recover the defining relations for Ti in 
terms of To, . . . , T„, X%, . . . ,X n , see Corollary 13.31 from the relations in V. Since the elements 
Vi, i = 0, . . . , n, generate an algebra isomorphic to H(tn r ), we need to find pairwise commuting 
elements Vi G V, i — 1, . . . , n, such that ip(vi) = Xi, and the following cross-relations holds, see 
(EH): 



(3.4) V i p(v)-(sip)(v)V i =d i (v;t)[(s i p)(v)-p(v)], i€[0,n}. 

Here we use the usual notation p(v) — ^Z^c^v^, if p(x) is the polynomial c^x^, and 
<•.-«£» far/ieZ£ . 

Let us first introduce the elements Vi. We define in V 

v n = -V n - V„, 

and we define Vi recursively by 

(3.5) v i = V i v i+1 V i -tV i , ie[l,n-l], 
then ip(vi) = Xi for i G [!,«]■ Note that we may write Vi explicitly as 



(3.6) fH = - (? i>n + TV n + t v ij) . * e [l,n], 

where 



i=i+\ 





= ViVi+i ■ 


"Vi- 


-2^-1^-2" 


■■V i+1 Vi, 


1 < i < j < n 


T 

x 1,71 


= V i V i+1 ■ 


■ ■ v n . 




■V i+1 Vi, 


i E [1, n], 


i.n 


= ViV i+1 ■ 




-iCK-! ■ • 


■V i+1 Vi, 


i G [1, n}. 



For vi the compatibility relation (|3.3[) gives 

vi = -+V + V Q 
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so using the recursion relation for Vi again we also have 

1 1 
(3.7) v i = - + T , i + rl i + t^2v 1 , j , ie[l,n], 

where 

T 0j i = V r i _iV;-_2---V r iV r o^i---V r i _2V;-_i, *e[l,n], 
= Vi-xVi-i ■ ■ ■ VxVtfVi ■ ■ ■ Vi-iVi-u i e [l,n]. 

We can now show that we have all the relations from Lemma [3~H in V. 
Lemma 3.8. The following relations hold in V: 

(vi ~ \ ~ V Q f = u%, 

ViViVi = v i+ i - tVi, ie[l,n—l], 

Vi Vj = VjVi, j e [Q,n], i G [1, n], \i - j\ > 2, 

ViV i+ i = Vi+iVi, ie[l,n-l]. 



Proof. The first three relations follow directly from the definition of Uj. Fix i £ [2,n]. In V we 
have 

[t/i, U 2 ] = 0, C7i G {V V , V , Vi,..., Vi-*}, 

U-2 £ {V^j+l, Vi t i + 2, . . . , Ti tTl , T i n }. 

These relations are easily verified using [14, V/] = [Vq V , Vi] = [14, V^] — for k £ [Q,j], I £ [i + l,n]. 
Now from (|3.6p we find for j € [0, i — 2] 



= (r.r,,, + v s ry n + 1 £ ^v;, fc 



fc=i+l 



= -(Ti,nV J +T t y n V j +t £ 



fe=t+l 



Hits-. 



Next we fix i £ [1, n — 1]. Now we use the relations 

[Ui, U 2 ] = 0, Ux£ {V i+l , v i+2 , ...,v n , O, 

u 2 £{r 0}i ,rl i ,v 1 , 2 ,v 1 , 3 ,...,v l , i }, 

then by (|3.7p we have for j £ [i + l,n] 



k=2 

= \v s + TOM + rlM +t y £vi, k v j 



k=2 

= ViVj. □ 

We still need to show that the subalgebra generated by Vi, i = 1, . . . ,n, is commutative. Once 
the commutativity of the Vi's is established, the cross- relations Q3.4p follow from Lemma l3~81 The 
following lemma will be useful for proving the commutativity of the v^s. 
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Lemma 3.9. We have the following relations in V: 

v i V ( ? = V ( ?v u ie[2,n], 
« 4 V n v = te[l s n-l], 



Proof. For the first two relations see the proof of Lemma l3.8l The last relation follows from writing 
out [« n _i,p^] — in terms of V n —i,V n and , and using the braid-type relations for V n and 
Vn-l- ' □ 

We are now ready to prove the commutativity of the Vi's, which completes the proof of Theorem 
Lemma 3.10. For i,j G we have ViVj = VjVi. 

Proof. We first show that v n -\v n — v n v n —i- By (|3.5p and the definition of v n we have 

Vn-lVn = V n -lV n V n -lV n - tVn-lVn 

= V n -!(V n + VV)V n -i(V n + C) + tVn-xVn + tVr^xVZ. 

By Lemmas 13. 8[ 13.91 and the braid-type relations for V n and we obtain from this 

Vn-lVn = {V n + V^)V n ^(V n + V^)V n -i + tV n V n - X + tV^-l 
= V n V n -iV n Vn-l ~ tv n V n -i 
= V n V„-i. 

Next, we show that v n Vi = ViV n by backward induction on i. The statement is true for i = n— 1. 
Suppose that = Vi+iv n for some i € [l,n — 2], then it follows from (|3.5[) and Lemma 13.81 

that 

v n Vi = v n ViV i+ iVi ~ tv n Vi 
= ViV n v i+ iVi - tViV n 

= ViV i+1 V n Vi - tViV n 

= ViV i+ iViV n - tViV n 

= ViV n . 

This proves the induction step. 

Finally, let i G [1, n — 1]. A similar induction argument as above shows that v^j = VjVi for all 
je[i + l,n]. □ 

3.2. The duality isomorphism. We define an involution a on the multiplicity function t by 

= (U n , Mo, t, t n , t()), 

i.e., the values of t on the ao-orbit and the a^-orbit are interchanged. If an object depends on t 
we attach a superscript or subscript a to denote the same object depending on t CT , for example, 
H a = Ti.(t a ) and we denote the elements in this algebra by Z a [Z € Tt). 
For ease of notations, we will write 

Uo = T V , U n = E^ n . 

Note that Uf — it?, and Uo, U\,Ti, i £ [0, n], form a set of generators for the algebra Ti. 

Proposition 3.11. The assignments 

Uo (7 ff , U n i * T^ To i * E7£, Ti [1, n]), 

extend uniquely to an isomorphism a :Ti — > 7^, respectively an anti-isomorphism ip : Tt — > Wo-. 
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To prove Proposition 13.111 we only need to check that a and ip preserve the defining relations 
for 7i, which is a straightforward exercise. The only relation that is not obvious is the braid-type 
relation for U n and Ti; 

U n T x U n T x + tU n T x = 7W„7W„ + mu n . 

We prove a slightly more general result which is useful later on. The relation with U = and 
j = 2 is the desired braid- type relation for U n and T\. 

Lemma 3.12. For j 6 [2, n] the following braid-type relations hold in TL: 

UT ltj UT hj + tUT ltj = I.Jl\J + tT hj U, U e {T , T V , H 1>n , 3^}. 

Proof. Let us first prove the identity for U = Si n . The identity for U = n is proved in exactly 
the same way. Using T n = Tx n Si n Ti <n and T\ n T\^T\^ n = T^ n we find 

^ljn-^ljj 1 — 'l,n-^l,j t^i^iTi j — ^l,n f-^n-^j*,n-^ri-^j',ri ~t~ tT n Tj n ^jTi n . 

We write out Tj „ in terms of TVs, then by repeated application of [T<,7^] = and Tf = 1 the 
expression between brackets becomes 

T n (Tj ■ ■ ■ T n -x ■ ■ ■ Tj)T n (Tj ■ ■ ■ T„_i ■ • • Tj) + tT n (Tj ■ ■ ■ T„_i • ■ -Tj) = 

Tj ■ ■ ■ T n —2{T n T n -iT n T n -i + tT n T n -i)T n -2 • ■ • Tj. 

Now use the braid-type relations between T n and T n _i and reverse the above steps, then we obtain 
the desired identity. 

For U = Tq,Tq the desired identities for j = 2 are precisely the braid- type relation between 
U and T\. For j £ [3, n] the desired identity follow easily from writing T\ t j = Tj-i ■ ■ ■ T\ ■ ■ ■ Tj-\, 
the braid-type relations between U and T\ , and repeated application of the relations [U, T] = 
and Tf = 1 for i G [2, j - 1]. □ 

3.3. The commutative subalgebra Vy. For i S [l,n] we define elements Yi S -ff by 

(3.8) Yi = 5j iTl + So,j + t Tjj-. 

j=i+i 

From this definition it is clear that 

Yn = ^n,n + "0,n = T 1 ,! + T" n _i • ■ ■ T\TqTi ■ ■ ■ T n _i, 

and 

Yi+i = TYiTi — tTi. 

We denote by 7-V C H C 7i the subalgebra generated by Yi , . . . , Y n . From the definitions of Yi 
and the algebra = H(t-jz) it follows that is generated as an algebra by Yj, TJ, i = 1, . . . ,n. 
Observe that cr(-Xi) = — Yj CT , so using the duality isomorphism a it is easy to find properties for 
the Yi's from the properties of the -XVs. Note that we also have ip(Xi) — —Yf, where ip is the 
duality anti-isomorphism. 

Proposition 3.13. Vy = C[Y X , . . . ,Y n ] 

Proof. This follows from Vy = u{V x ), V x = C[Xf , . . . , X%], and the fact that a is an isomor- 
phism. □ 

Proposition 3.14. We have the following relations in H , 

T lP (Y) - (s lP )(Y)T t = ck(Y-X)[p(Y) - (s iP )(Y)], % e [l,n], 

for p E P. 

Proof. This follows from applying the isomorphism a a to the relations (|3.ip in Ti a . □ 
Corollary 3.15. As a vector space, H is isomorphic to Vy ® Hq and Hq (8 Vy . Consequently, 

H^Vy<E)Ho<E)V x ^Vx<E>Ho<E>r Y 

as vector spaces. 
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Remark 3.16. It should be observed that the elements Yi are not invertible, which is different from 
the usual (double) affine Hecke algebra. 

3.4. The rational GDAHA for type D4. We end this section by showing that the rational 
DAHA H(t) is isomorphic to the rational generalized double affine Hecke algebra (GDAHA) of 
rank n attached to an affine Dynkin diagram of type D4 as defined in [5J Definition 2.2.1]. We 
recall the definition here. Actually in [5] a rational GDAHA of rank n is associated to any star-like 
graph that is not a finite Dynkin diagram. 

Let v € C, ji = (fj,i , jjiiy , fii 2 , fii 3 , Hi 4 ) <G C 5 , and let 7^ — 7&(/i) {k € [1,4]) be complex numbers 
such that J2k=i 7fc = Mi ■ 

Definition 3.17. The algebra B = B(ijl,v) is the complex associative algebra generated by V^k 
(i = 1, ...,n, k — and the symmetric group S n with the following relations: for any 

i, j, k S [1, n] with i 7^ j, and I, m G [1, 4], 

SijV k ,i = Vk,iSij if k^ 

(Vk,i-fi)(Vk,t-'n-iHr) = o, 

V it l + Vi, 2 + V i>3 + Vi A = Sl > ' 

\Vi,i,V j ,i] = v(V il i-Y i ,i)s iJ , 
[V U ,V j , m )=Q, l^m, 

where Sij £ iS n denotes the transposition i «-> j. 

The algebra B essentially only depends on the parameters /i and v, see also Remark 2.2.2]. 
We are going to show that B is isomorphic to TL for appropriate /j, and v. For this the following 
lemma is useful. 

Lemma 3.18. The algebra B is generated by Vi :— V\j (I € [1,4],) and Sj := Sj^+i (i G [l,n — 1]), 
with relations, for I G [1, 4], i G [1, n — 1] and j £ [2, n], 

«i = 1, 
SiSi+iSi = Si+iSiSi+i, 
S4V1 = ViSi, i ^ 1, 
(Vi-~/i)(V l -~/ l - f M ir )=0, 

71-1 

Vi + V 2 + V 3 + V4, = v sifc, 

k=2 

[Vi,sijVisij] = v[Vi,sij], 
[Vi, SijVmSij] = 0, me [1,4], m ^ I, 

where s\j = S1S2 ■ ■ ■ Sj_2Sj-iSj-2 • ■ ■ S2S1. 

The proof is a straightforward exercise. We can now show that the rational GDAHA B is 
isomorphic to the algebra Tt. 

Theorem 3.19. Let //(t) = (5 — to — uq — t n — u n , 2to, 2uq, 2t n , 2u n ). The assignments 

ip(si) =Ti, i € [l,n- 1], 
ip(Vi) = T + 71 + t , <p(V 2 ) = T V + 72 + uo, 
(p(V 3 ) = Si,„ + 73 + t„, (p(V 4 ) = + 74 + it„, 

extend uniquely to an algebra isomorphism ip : _B(/i(t), —t) — > 7Y(t). 
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Proof. Note that H is generated as an algebra by To, Tq, Hi, n , S^ n and Ti, . . . , T„_i, hence 99 maps 
generators to generators and is therefore surjective. It is an almost straightforward computation 
to check that <p preserves the relations for B from Lemma 13.181 Let us remark that the relations 

(3.9) [Vi, Slj V lSlj ] = v[V hSlj }, I £ [1,4], j £ [2,n], 

are equivalent to the braid- type relations from Lemma 13.121 
We define <p : TL(t) — > B(^i(t), —t) on generators by 

(p(Ti) = Si, i £ [l,n- 1], 

if (T ) = V\ - 71 - i , ^(Tq) = V 2 - 72 - u Q 

<f(T n ) = si n V 3 si n - 73 - t n &{Tn) = Si n ViS ln - 74 - t n . 

It is now easily checked that (p preserves the relations for TL from Theorem l3.71 so that <p, extended 
to Ti as an algebra homomorphism, is the inverse of ip. □ 

4. The polynomial representation 

In this section we define and study a representation of H. in terms of difference-reflection oper- 
ators. 



Let x '■ H — > C be the trivial representation defined by x(T) = Xi with 

U, i = 0,n, 



(4.1) Xl 



1, i £ [l,n- 1]. 



Using TL ~ H ® as vector spaces, and identifying with T 5 , we define the representation 
it : Tt — > End('P) to be the induced representation 

7T = Ind^(x). 

We call 7r the polynomial representation of TL. From the cross-relations p.l|) we find the action 
of the generators of TL. 

Proposition 4.1. Lef p £ V. The actions of the generators T (i £ [0, n]^ and Xi (i £ [l,ra]J on 
"P are given by 

(iv(Ti)p)(x) = Ci(x){s t p){x) - di(x)p(x), i £ [0,n.], 

(7r(X t )p)(.x) = x 4 p(x), i £ [l,n], 

where Ci(x) = Ci(x;t) are rational functions defined by 

Ci(x) = dt(x) + Xi, i£[0,n]. 
Explicitly, the rational functions a are given by 

(ti + Ui + a%(x)) (U - Ui + aV(x)) 



-, i = 0,n, 

ai(x) 

t + cn(x) 

1 £ [1, n — 1J. 



Ci(x) = 

a* (a;) 

An easy computation shows that 

(4.2) a(x) + {s l a){x) = 2y,, ie[0,4 

We will also use the notation, for a € 7?. r , 

f ((t(a) + t(a v ) + a v (x)) (t(a) - t(a v ) + a v (x)) 

c«(a:;t) = | v , , . "(^ 
I t(a)+a(x) 

7 \ , (a, a) =2. 

I. a(x) 

Observe that c ai = Ci for i £ [0, 71], and wc a = c wa for u> £ W. 



(a, a) = 4, 
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Remark 4.2. (i) Note that for t = we have 7r(T,) = s;, i € [l,n — 1]. Moreover, setting 
(to, u , tn, u n ) = (a, -a, a, -a) we find 

lim (n(tr x Ti)p){x) = (s iP )(x), i = 0,n, 

for peP. 

(ii) Noumi's [Hj representation of the affine Hecke algebra of type C n on C[q ±Xl , . . . , g ±a: ™] is 
given by 

> _ 1 (i-fc a ,fc a , /2 ^(-)/ 2 )(i + fc ai fc a - i /2 ^(-)/ 2 ) 

Fi = fc aj + fc ai _ x) '- (s { - 1), i 6 [0,nj, 

Here /c is a multiplicity function on 7?. nr , and fc a ./ 2 = 1 if ^ 7?. nr . Setting 

(*oo,feao/a.*oi.*b„,fco„/2) = (-ig to ,ig Uo ,g t/2 ,-V",i<?""), 
we find formally for q ^ 1 (see also [101 Section 2.4] and [TJ Section 4]) 

lim — — — = 7r(Tj), i = 0, n, 

g-»l l — g 

lim Vj = 7r(Tj), ie[l,n-l]. 

So the representation tt of 7i can formally be obtained as a limit of Noumi's representation of 
the DAHA associated to TZ nr , see Q2]. In view of the next proposition the algebra H may be 
considered as a degeneration of the DAHA associated to lZ nr . 

Proposition 4.3. The representation tt : H — > End(P) is faithful. 

Proof. Suppose that tt( J2 w ew fw{X)T w ) = 0, with f w (X) G Px- We may write tt(T^) = 
Eii<io tt i"-«( j; ) M with a^^a:) G C(x) and a TO)W (ic) is nonzero. Let d(x) be the product of the 
denominators of all a w ^ u (x), then 



= d(x) ^ fw(x)a WyU (x)u. 



u,w£W 

We may consider the expression on the right as an element of the degenerate DAHA S)(0) ~ V®W, 
with the multiplicity function which is equal to zero on all W-orbits in lZ r . Now it follows in 
the same way as in the proof of Proposition 12.31 that f w (x) is the polynomial identically equal to 
zero for all w G W, hence tt is a faithful representation of H. □ 

The representation tt restricted to the subalgebra H gives a representation of H . We are 
going to decompose V, considered as a 7r(_ff)-module, into irreducible 7r(ff )-modules. In view of 
Proposition 14. 31 we identify from here on the algebra 7i with the algebra 7r(W) C End('P). 

It will be useful to understand the action of the operators Tj on monomials. For v = X)T=i Vi€i ^ 
Z> we write \v\ = Yh=i v i- 

Lemma 4.4. For A G A and v = 4>(X), we have 

(A, e x ) >0, 

M<M 

'^ A ) - (t - (\,e 1 ))x u + c ^ x ^ (Vi}<0, 

M<M 

T i x v = x' t, ^ + c ^ x ^ »e[l,n-l], 

t n X U , (A, Cn) > 0, 



T x» = 



t n x 



for certain coefficients c v>1 G C. 
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Proof. For T and T n this is proved in [lOj Proposition 2.5]. For T i: i 6 [l,n — 1], we write 
Ti = Si + tDi, where 

a^x) 

We use s^x 1 ') = x Siiy . Then from SiV — v — ma*, where m = (y, a,), we obtain 
= (ag)^-ig = x"(x- ma ' - 1) 

Oi(x) X i+ i(x a ' - 1) 

— Ci+l— a; ^.y — 2ai jiz-tiii-maj m > 

0, m = 0, 

x v-e i+ i + x u-e i+ i+ ai + „ . . + a .f-e <+ i-(l+m)o <! m < 0. 

All these terms are of degree lower than |z/|. □ 

4.1. Intertwiners. For i £ [0, n] we define the elements Sj € 7i, called intertwiners, by 

50 = [U n ,a (Y]], 

51 = [Ti,ai(Y)], i e [l,n]. 

We define another action of W on Vc by for i G [1, to] and 

so • £ = {-xi -1,X2,-.., x n ), x = (xi, . . . , x 2 ) £ Vc- 

We also define a dot-action of W on V by (it) • p)(x) — p(w^ 1 ■ x). Note in particular that the 
action of the commutative subalgebra t(A) is given by (r(ei) ■ p)(x) = p(x — ej). 

Lemma 4.5. TTie intertwiners Si satisfy the following relations in TL: 
(i) The braid relations of type C n 

SiSi+iSiSi+i — Si+iSiSi+iSi, i = 0, n — 1, 

SiSi+iSi — Si+iSiSi+i, i £ [1,1- 2], 

SiSj=SjSi, i,je[0,n], \i-j\>2. 

(ii) The quadratic relations Sf = qi(Y) with qi(x) = —2ai(x) 2 c ai (x)c- ai (x), i.e., 

f 4((u„ + u ) 2 - (| + Xl) 2 ) ((«„ - Uq) 2 -{\ + xi) 2 ), i = 0, 
q l {x)^U{t 2 -a l {x) 2 ), *e[l,n-l], 
+ i ) 2 - x 2 ) ((t n - t ) 2 - x 2 ), i = n. 

(Hi) For peP, 

S iP (Y) = ( Si -p)(Y)S h ie[0,n]. 

Proof. First we apply the duality isomorphism er : 7i — > 7i CT and then the representation 7r CT : 
H CT -> End(P), then by §51$ we have 

(7r CT o a) (Si) = -2a i (x)c i (x)s i . 

Properties (i) and (ii) follow from this after an easy calculation. Property (iii) follows in the same 
way, using also (jx a o a)(p(Y)) = p(—x). □ 

For w £ W we define intertwiners S w by Si = 1, and 

Sw ' ' ' &i r 

for w = Sjj • • • Si r £ W a reduced expression. This is independent of the choice of the reduced 
expression, since the Si's satisfy the braid relations of type C n . From Proposition 14 . 51 we now find 
the following relation in Ti. 

Corollary 4.6. For p £ V and w £ W the following relation holds in Ti.: 

SU^- 1 ■ P )(Y)=p(Y)S w . 
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4.2. Nonsymmetric multivariable Wilson polynomials. For A £ A let A + be the unique 
element in Wo An A + . There is a unique shortest element (with respect to the length- function / on 
W) v\ £ Wo such that v\ ■ A = A + . We define u\ £ W by u\ = t(—X)v^. We give a few useful 
properties of u\, which are proved in 1141 Section 2.4]. 

Lemma 4.7. For A £ A the element u\ has the following properties: 
(i) t{— A) = U\V\ and r(— A + ) = v\U\. 

(ii) u\ is the unique shortest element in W satisfying u\ ■ = A. 
(in) If 0{(A) 7^ /or z € [0, n], then SiU\ = u H .\. 
(iv) Ifa,i(\) < fori £ [0,n], f/ien l(u Si .\) — l(u\) — 1. 

fwj If ai(X) — for i £ [l,n], then there exists a j £ [l,n] such that SiU\ = u\Sj. 

We now define polynomials labeled by A £ A generated by the intertwiners from the constant 
polynomial 1 £ V, see also )15j . 

Definition 4.8. For X £ A we define the nonsymmetric multivariable Wilson polynomial p\ £ V 
by 

Px = S Ux l. 

We see that p\ is a nonzero polynomial for any A £ A. We show that the polynomials p\ are 
eigenfunctions of the ^-operators. 

Remark 4.9. We show later on that the polynomials p\ are nonsymmetric versions of the multi- 
variable Wilson polynomials as defined by Van Diejen which justifies the name. In this paper 
we will often call p\ a Wilson polynomial. 

Note that the constant function po = 1 £ V satisfies Tipo — XiPo f° r i G [0,n], see (|4.1|) . Now 
from the definition of the V-operators we see that 

YiPo = 7o,iPo, 7o, i =t + t n + (n - i)t. 
For A £ A we define elements 7a £ Vc as follows: 

n 

J\ = u x - 70, 7o = ^2 7o,i£i- 

i=l 

From the definition of u\ it follows that 7a can also be written as X + v^ 1 -70- From here on we 
assume that the parameters to,t n ,t are such that 7a 7^ if fi =/= X. We have the following useful 
lemma. 

Lemma 4.10. Let p £ V and X £ A, then 
(i) s t ■ 7a = 7 Si .a for i £ [0,n]. 

(ii) (sip)(-jx) =p(-7*i-A) and (si ■ p)(j\) =p(j Si -\) fori £ [0,n] with s, ■ A ^ A. 
For the proof see [18, Theorem 5.3]. 
Theorem 4.11. For f £ V and X £ A, we have 

f(Y)px = f(lx)Px- 
Proof. By Corollary 14.61 and Lemma f4. 101 we have 

f(Y) Px = f(Y)S Ux l = S ux (u^ ■ f)(Y)l = (u- 1 ■ f)( l0 )S Ux l = f( lux .o) P x = f(lx) P x. □ 
For Ae Awe define eigenspaces 

Vx = {p £ V I f(Y)p = f{ lx )p for all / £ V}. 
Clearly, we have p\ £ V\, so V\ is nonempty and nonzero for every A £ A. 
Theorem 4.12. The set {p\ | A £ A} is a basis for V . 
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Proof. We first show that the eigenspaces V\ are all 1-dimensional. Let p G V\. Observe that for 
t = we have T, = Sj, which gives us for the Y"-operators 

Yj = Si ■ ■ ■ s„_iT„s„_i ■■■s i + Si_i ■ ■ • siT si • • • Si-!. 

This is the F-operator for the rank one version of the algebra TL (see acting only on the 

ith variable. For any m G Z>o the rank one y-operator has exactly one (up to a multiplicative 
constant) polynomial eigenfunction of degree to, which is uniquely determined by the coefficient 
of x m . This means that for t = we have 

p(x) = Cp tp{ x 1 )(xi)p t p(X 2 )(x 2 ) ■ ■ ■p < j>(X n )(x n ), 

where p m denotes a one- variable nonsymmetric Wilson polynomial of degree m, and c is a nonzero 
constant. So the coefficient c\ of in the expansion p{x) = X^ieA £ A a; * ( ' A1 ' ) is nonzero after 

setting t = 0, which implies that c\ is generically nonzero. Now if dim'PA > 1, then there would 
be a nonzero polynomial in V\ for which the coefficient of equal to zero, hence dim V\ = 1. 

Finally, we define for m G Z>o, 

n n 

V (m) = spanja^A | A = ^ € A, ^ |A,| < to}, 

i=i »=i 

then T 5 = Um=o^(m)- Since J2i^t = Si M f° r au A G A, we see from Lemma FOl that 
the intertwiners SA i G satisfy SiV/ m > C 7-V m ), while So"P( m ) C 7-V m +i). It follows that 

Pa € T^at) where TV is the number of times So occurs in a reduced expression for u\. By Lemma 
14.71 we have u\ = w^ 1 r(— A+) with v\ G Wo, so A^ is also the number of times so occurs in 
t(— A+), i.e., AT = JA A+. So for any m 6 Z> the set {p\ \ JA M — m l c ^(m) nas * ne same 
cardinality as the basis {x^ x "> \ JA |Aj| < m} of Since the polynomials p\, JA |A<| < m, are 

eigenfunctions of the ^-operators for pairwise different eigenvalues, they are linear independent 
in Vr m )t hence the set {p\ | JA |Aj| < m} forms a basis for Vi m y □ 

We have the following corollary of the proof of Theorem I4.i2l 

Corollary 4.13. The eigenspaces V\, A e A, are all one- dimensional. Furthermore, a polynomial 
in V\ is uniquely determined by the coefficient of x^ x ' . 

We define for A G A+, 

V{\) = span{p M | n G W X}. 
We are going to show that V(X) is an irreducible 7r(iJ)-module. 

Lemma 4.14. Let A G A and i G [0,n], then 

{ 0, o<(A) = 0, 

SiP\ = < p Si .\, Of(A) > 0, 

[ffiClsi-A^-Ai «i(A) < 0. 

Proof. Let us first assume that cij(A) 7^ 0, i.e. s, • A 7^ A. We have SiPA = SiS ux l. Let • • • Si r be 
a reduced expression for u\. We need to find out if SiS^ ■ ■ ■ Sj r is a reduced expression for SiitA- By 
Lemma T4. 71 we have u s< .a = SjWA- If l(u Si .\) > l(u\), then SiSi 1 ■••Sj r is a reduced expression for 
u Si .\. In this case SiS Ux — S Us , A , which implies S^pa = Ps ; a- If l(u Si -\) < l( u \), then there exists 
a reduced expression for u\ which starts with Sj. This shows that S{S Ux — SfS Us ,_ x . From Lemma 
14.51 and Theorem 14.111 we then obtain SiP\ = Sfp Si .\ = qi(^ Si .\)p Si .\. By Lemma T4. 71 a A A) < 
implies l(u Si .\) < l(u\). Replacing A by Sj • A then shows that fli(A) > implies l(u Si .\) > l(u\). 
This proves the lemma in case GSi(A) A 0. 

Now suppose that ai(A) = 0, i.e. Sj • A = A, which only happens if i 5^ 0. In this case we have 
(siU\) • = Si ■ A = A. Since u\ is the shortest element in W satisfying u\ ■ = A, we have 
l{siU\) > l(u\). Furthermore, by Lemma 14.71 there exists a j G [l,n] such that SiU\ — u\Sj. This 
shows that SiP\ = SiS Ux l = S Ux Sjl. Observe that Sjl — [Tj,a,j(Y)]l = 0, since Tjl = Xj, hence 
■S>a i). □ 
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The following result assures us that T{P{X) C V(X) for i £ [1,«]- Clearly, we also have 
Y{P[X) C V(X) for i £ [l,n\. Since the K-operators are diagonalized by p^, a nonempty invariant 
subspace V C V(X) contains an element p^ for some fi £ WoX. Repeated application of the 
intcrtwiners Si, i £ [l,n], then shows that for every v £ WqX we have p v £ V , hence V{X) is 
irreducible. 

Lemma 4.15. Let X £ A and i £ [l,n]. If di(X) 7^ 0, then 

T t p x = A it xp\ + B^xPsi-X, 

with Ai t x — df (7a) and 



Bi 



2a; (7a) 
. 2a s (7A) 



Oi(A) > 0, 
a; (A) < 0. 



Ifai(X) = 0, then Tip x = XiPx- 

Proof. Let i £ [1, n] and A G A. By Theorem 14.121 Tim can be expanded in terms of p M , (1 € A. 
From the cross-relation in Proposition 13. 141 we find for any / G V, 

(4-3) (/(F) - («i/)(7A))TiPA = (/(7a) - (sJ)(7a))<(7a)pa. 

Suppose that <2i(A) 7^ 0, then Sj • A 7^ A. In this case we find from Theorem 14. 1 II and Lemma 
14.101 that Tipx is indeed of the form A^xPx + B^xPst-X with A^x — (7a)- In order to find B^x 
we use the intertwiner Si. By Lemma T4. 141 we have SiPx — 9i,xPsi-x where 



9i,X = 



1, Oi(A)>0, 
^i{ls v x), a* (A) < 0. 
On the other hand, using Sj = [Tj, di(Y)] we have 

S^Pa = (oi (7a) - a t (j Si .x))B i: xp Sl -x, 

hence B^a = g^x/Za^x)- 

Now suppose that dj(A) = 0, then Theorem 14.111 and (|4.3p imply that XipA = df(-fx)px- Since 
s;- A = A it follows from the definition of 7a that o;(7a) = i for i £ [1, n — 1] and a n (7A) — 2io + 2i„. 
From the explicit expression for df (x) we then find (if (7a) = Xi- ^ 

From Lemma T4. 151 and Theorem 14 . 1 1 1 wc obtain the following result. 

Proposition 4.16. The center of H is equal to . 

Proof. From Proposition 13 . 141 it follows directly that the subalgebra commutes with genera- 
tors Ti of H, hence is contained in the center of the algebra H. 

Let Z be an element in the center of H. By Corollary 13 . 1 51 we may write Z = J2wew Twf w {Y) 
with f w (Y) £ Vy . Since Z commutes with Vy , Z acts as a constant on px, hence 

fw(lx)TwPx = cpx, 

for some nonzero constant c. By Lemma [4.15l we have T-^fpx = ^2 V < W c wvP«-x for certain coefficients 
c* v £ C, and c* w 7^ for infinitely many A G A. This gives 

^2 fw(lx)ct v Pv-x = cpx, 

v,w£Wq 



which implies that for v ^ 1 
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Let m ^ 1 be a maximal element such that f u ^ 0, then c^ M = for infinitely many A G A. 
We conclude that only f\ is nonzero. Being a central element, Z — f\{Y) commutes with every 
intertwiner Si, i G [1 , n] . Lemma T4. 5 1 then implies that Sj/i = f±, hence fi(Y) G . □ 

Theorem 4.17. TTie decomposition 

(4.4) P = P(A) 

AeA+ 

is the multiplicity-free, irreducible decomposition of V as a ir(H)-module. Moreover, (|4.4[) gives 
i/ie decomposition of V into isotypical components under the action of the center of H , and 
the central character is given by X\(p(¥)) = Pilx) f or P(¥) € . 

5. NONSYMMETRIC MULTIVARIABLE WlLSON POLYNOMIALS 

In this section we derive a few important properties for the nonsymmetric multivariable Wilson 
polynomials, such as orthogonality relations, evaluation formulas and the duality property. These 
properties are obtained in the same way as in the case of the Koornwinder polynomials, see [TB] . 

5.1. Duality. We write x\ = ^\{t a ), A G A, for the spectrum of the operators Y a G Ha- We 
define evaluation mappings Ev : 7i — > C and Ev : H. a — > C by 

Ev(Z) = (Z(l))(-x ), ZeH, 

Ev(Z) = (Z(l))(- l0 ), ZeH a . 

The two evaluation mapping are related via the duality anti-isomorphism tp : TL — > TL a from 
Proposition 13.111 by 

(5.1) Ev(Z)=Ev(^(Z)), ZEH. 

Indeed, for Z — f{X)T w g(Y) with f,g G V and w — s il ■ ■ ■ Si r G Wo a reduced expression, we 
have, using ip(Xi) = -Yf and ip(Ti) = T? for i G [1, n], 

Ev(^(Z)) = (g(-X')7Z- 1 f(-Y'){l))(--ro) 
= Xa{K- 1 )f{-x )g{ 10 ) 

= (f{X)T w g{Y){l)){-x ) 
= Ev(Z). 

Here we use the reduced expression w^ 1 — Sj r ••■ Si 15 and x is the trivial representation of Hq. 
Note that x(T w ) — X^C^w- 1 ) f° r an y word w G Wq (and x<r : Hq — > C is defined in the same way 
as x '■ Hq — > C). By the PBW-property for W from Corollary 13. 151 we then see that (|5.1jl holds for 
all ZeH. 

With the evaluation mappings and the duality anti-isomorphism ip : 7i — > 7Y CT we construct two 
pairings B : W x H CT -> C and 5 : H CT x W -> C by 

B{Z,Z) = Ev(i/) tr (Z)Z), B(Z,Z)=Tfr(<tp(Z)Z), 

where Z £ Ti. and Z G 7ier. We have the following properties for these pairings. 

Proposition 5.1. Let Z, Zi, Z 2 G U, Z, Zi,Z 2 € U a and p G "P. TTierc 
(i; B(Z,Z)=B(Z,Z); 

(ii) B(Z 1 Z 2 ,Z) =B{Z 2 ,^{Z 1 )Z)jind B{Z,Z X Z 2 ) = B(ip (T (Z 1 )Z, Zj); 
(Hi) B((Zp)(X),Z) = B(Zp{X),Z) and B(Z,(Zp)(X a )) = B(Z, Zp{X a )) . 

Here p(X) is the multiplication operator (p(X)f^j(x) =p(x)f(x) for f G V . 

Proof. Properties (i) and (ii) follow from (15. ip . Property (iii) is an immediate consequence of the 
identity ((Zp)(X))(l) = Zp = Z(p(X)(l)) in V. □ 
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The evaluation Ev(p>(X)) = p\(~xq) of the nonsymmetric Wilson polynomial is nonzero for 
generic parameters t = (to, uq, t, t n , u n ). Indeed, for t = 0, the polynomial p x becomes a product of 
one-variable nonsymmetric Wilson polynomials £W Ai ) which are all nonzero at — Xoj — — {tn + w n), 
see |10[ Proposition 3.14]. In the next subsection we determine an explicit expression for p\{— x$). 

Definition 5.2. For A € A we write E(x,j x ;t) = E(x,j x ) for the constant multiple of the 
nonsymmetric Wilson polynomial p\(x;t) that takes the value 1 at x = —xq. 

As a consequence of Proposition 15.11 we obtain 

B(p(X°),E(X, lx )) =B(l,(p(-Y)E(; lx ))(X)) = p(- lx )B(l, E(X, 7 a)) , 

for any peV and A G A. Note that B(l, E(X, 7a) = Ev(E(X, 7a)) = 1, so we have 

(5.2) f{~ lx )^B{f{X a ) 1 E(X llx )) 1 g(-x^ = B(g(X),E a (X a ,x ft )), 

for /, g G V and A, p G A. The second identity is derived in the same way as the first. This 
immediately leads to the duality property for the renormalized nonsymmetric Wilson polynomials. 

Theorem 5.3. For A, /i G A the renormalized nonsymmetric Wilson polynomials satisfy the duality 
property 

£(-z M ,7A;t) = E(-j Xl x^;t a ). 
Proof. This follows from Proposition ^. lf i) if we set / = E a (-,Xfj) and g — E(-,j\) in (|5.2p . □ 

As a consequence of the duality property we obtain that the actions of Tj, i G [l,n], and 
U n on the renormalized nonsymmetric Wilson polynomials can be written as difference-reflection 
operators acting on the spectral parameters. 

Proposition 5.4. Let A G A, then 

(U n E(; lx ))(x) = c%{- 7x )E(x, 7so . x ) - ^(-7a)£(z, 7 a), 
(TiE(;<y x ))(x) = cU-lx)E(x nSi . x ) - dU-lx)E(x, lx ), i G [l,n]. 

Proof. It is enough to prove the result for x = — x^ for all fi G A. By ()5.2jl and Proposition 15. II 
we have for A, /i G A 

S^taMiT^*^^ ill , 

I (^J5(.,7 A ))(-af At ), !e[l,n]. 



Writing out T?E a (-, x^) we find using Proposition [STT] 

S(S(X, 7A ),(Tfi? CT (.,a; M ))(A-)) 

= J B( J B(X )7A ),<(X CT )( S ^ CT (-,^))(^)-df(X CT ) J E; a (Jf ff ,a ;;i )) 

= B«(Ar)( Sl £ CT (-, z M ))(X) - dftA^pf* E(X, 7A )) 

= <(-7a)(s j £' (T (-,^ i ))(-7a) - <(-7a)^ ct (-7a,^) 

= cf(- 7A )£?(-a; pj 7. 4 .A) - ^(-7a)^(-^,7a)- 

The last two lines follow from (15. 2ft . Lemma [4.101 and the duality property for the nonsymmetric 
Wilson polynomials, Theorem 15.31 □ 



If cii(A) ^ we already know that SiE(-,~/ x ) = cE{-,~/ Si . x ) for some nonzero constant c. Using 
Proposition [5T4] the constant c can be calculated. 



Corollary 5.5. Let i G [0, n], and let A G A smc/i t/ia£ Sj • A X, then 

SiE(; lx ) = 2 ai ( lx X(-7x)E(; lsi . x ). 
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5.2. The evaluation formula. Using Corollary [53] we can determine the value of p\(— xo)- 
Theorem 5.6. For A G A, 

P\(-X ) = Y[ K a(-Jo), 

where 

K a (x) = 2a(-x)cl(x). 

Proof. By the definition of E(x,^\) we have p\ = px(—xo)E(-,j\). Recall that p\ — S Ux l, and 
let u\ = Si x • • • Si r be a reduced expression. Using Corollary 15.51 we now find 



Px(-x ) = Y[K atk {~ 1{s . h+i ... s . r) . ). 



k=l 

Recall from Lemma 14.71 that u\ is the unique shortest element in W such that u\ ■ = A, so 
(si k s ik+1 ■ ■ -s ir ) -0 7^ (s 4fc+1 • • • s ir ) -0. By Lemma|4~T0]we have K a (-j w . ) = K w -i a (-j ) for w e 
W, so we can write p\{— xq) as a product over the set S = {/3i, . . . , f3 r } with (3k — s.; r • • • Si k+1 at k 
for fc S [1, r]. It is well known that the set S is equal to 7?.+ n u^TZ' , which proves the result. □ 

5.3. Orthogonality relations. With the multiplicity function t we associate the Wilson param- 
eters a, b, c, d given by 

(a, 6, c, d) = (i„ + u n ,*„ - u„,t + u + ^,t -u + ^). 
We assume from here on that a,b,c,d,t > 0. We define A(-) = A(-;t) and A + (-) = A + (-;t) by 

. . -p-r T(t ± xj ± Xk) -rj T(a ± Xj)T(b ± Xj)T(c± Xj)T(d ± xj) 

A+{x;t) = H T(± Xj ±x k ) U r(±2a; J -) ' 

and 

A(a:;t) = c+(a;;t)A+(x;t), 

where 

(5.3) c+( x;t)= n c a ( X -,t)= n (t 7 lj t' Ifc i5''- j T fc) n (a "-f 

To the weight functions A and A + we associate two nondegenerate bilinear forms on V by 

(f,9)t= ! f(x)g(x)A(x;t)dx, 

J(WL) n 

(/,5>t + - / f(x)g(x)A + (x;t)dx, 

where dx — (2T:i)~ n dxi dx-i ■ ■ ■ dx n , and iR has the standard orientation. The constant terms can 
be given explicitly; 

<i i>+ = 2-n! f[ . T(tj) n ^*«^ r ^ + vi + u - m 



3 



i r(t)r(wi + v 2 + v 3 + Vi + (n + j - 2)t) ' 



where (v\, i>2, t>3, V4) — (a, b, c, d), see From Stirling's formula it follows that the polynomials 
are integrablc on (iR) n with respect to both A and A + . Let us remark that the weight A + is 
positive on (iR)" under the current conditions on t. 

Let 1 : TL — > TL be the anti-isomorphism defined by i{Ti) — Ti, i G [0, n], and l(Xj) = Xj, 
3 e [l,n\. 

Lemma 5.7. Let f,g G P and Z eH, then (Zf,g) t = (f,t(Z)g)t- 
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Proof. It suffices to show that the generators Tj and Xj are symmetric with respect to (•, -)t- For 
the Xj's this is obvious, so we only need to verify it for the TVs. Writing out (Tj/, g)t we see that 
the proof of the lemma boils down to proving the following identity: 



(5.4) / (sif)(x)g(x)ci(x)A(x)dx = / f(x)(sig)(x)ci(x)A(x)dx. 

J(iR)" J(m) n 

Using the definitions of Cj, Q = 1, . . . , n, and A one checks that the function Ci(x)A(x) is invariant 
under the action of Si. Now for i — 1, .. . ,n the required identity (|5.4p follows from substituting 
x i — ► Six on the left hand side. For i = we denote y = (x2, ■ ■ ■ , x n ) and a(x) — oc{x\, y) for any 
function a depending on X\, . . . , x n . We substitute x\^ l — y\ in the left hand side of (|5.4[) . then 
this becomes 



f(yi,y)g( 1 - yi,y)co{yi,y)A(y 1 ,y)dy 1 dy. 

I yi el+m. JyG(iR)"- 1 

The function yi t— > co{yi,y)A(yi,y) does not have poles inside the strip {0 < 5i(f/i) < 1} due to 
the conditions on the parameters. Using Stirling's formula it follows that the integral over the line 
segment {yi = x + iB \ 0<x<l} vanishes for B — > ±oo. By Cauchy's theorem we may then 
shift the contour 1 + iM to iR without changing the outcome of the integral. This proves identity 
flOl) for i = 0. □ 



The F-operators satisfy i.(Yi) — Yi, i E [l,n]. From the previous lemma we then immediately 
obtain orthogonality relations for the Wilson polynomials. Combining this with Theorem 14. 121 we 
have the following result. 

Theorem 5.8. The nonsymmetric Wilson polynomials form an orthogonal basis for V with respect 
to ( v ) tj i.e., 

(PA,2V)t=0, A^. 

Remark 5.9. There is a fundamental difference with the DAHA of type (C v , C„). In that algebra 
the identity i(Y{) = Yi is not valid for the corresponding Y-operators. Therefore, the poly- 
nomial eigenfunctions of the K-operators, the nonsymmetric Koornwinder polynomials, satisfy 
feiorthogonality relations, see [T5] . 

Next we compute the diagonal terms (E(-, 7 A ), E(-, 7 A ))t- 

Lemma 5.10. For A S A and i £ [0,n], 

(£(., 7A ),£(-, 7 A))t = -^^(E(-,-y s , x ),E(., 7s , x )) t . 

Proof. By Lemma 15.71 and the definition of the intertwiners Si we have 

(Sif,g)t = -(f,S i9 ) t , f,geV. 

Since SiE(-,j x ) = bx,%E{-,^ Si .\), with given in Corollarv l5.51 we have 
(S i E(-,' Yx ),S i E(. ) < rx )) t = 6^(S(., 7si . A ),S(., 7si . A )) t . 

On the other hand, by Lemma 14.51 we have 

(SiE(; 7x ), S t E(-, lx )) t = -(E(; 7 a), SfE(., 7A )) t 

= - qi ( 1X )(E(; 1X ),E(; 7X )) t . 

Now the result follows from —b\ i/qi{"ix) — c - ai (7A)/ c a 4 (7a)- ^ 
For Ae Awe define 

i \ 1 tt c -«(7a) 

aGTC+rm A TC,. 

From 70) = 1, Lemma 15.101 and arguments similar as in the proof of Theorem 15. 61 we see that 
7V(7 A ) _1 is the 'quadratic norm' for E(-,j\). 
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Theorem 5.11. For Ae A, 

(£(-,7A),£(-,7A))t = 




5.4. The Fourier transform. We define 

Spec(-F) = {- 7A | A e A}. 

Let F be the vector space of complex-valued functions on Spec(— Y) with finite support. A linear 
basis for F is formed by the functions 5\, Ae A, given by 

<5a(-7m) = 

We define a bilinear form [•, •] : F x F — > C by 

[f,g]t= £ /(7)ff(7M-7;t) 

7eSpcc(-Y) 

The functions 6\, A £ A, are orthogonal with respect to this bilinear form. 
We define the polynomial Fourier transform T : V — ► F by 

(^P)(7) = (P, -7)>t, ?eP, 7 e Spec(-Y). 

Since the bilinear form (•, ■) is nondegenerate, the map T is an injective map. Moreover, J-E(-; 7a) 
is a multiple of J^, hence T maps an orthogonal basis of V to an orthogonal basis of F, which 
implies that T is surjective. We also define a linear map Q : F — > V by 

(g g )(x) = [.9,^,--)]t= £ 5 ( 7 )i?(x,-7)A r (-7;t), g£F,x£C n . 

7es P cc(-y) 

Theorem 5.12. TTie map Q : F — > V is the inverse of the Fourier transform T : V — > F '. 
Moreover, we have the Plancherel-type formulas 

[Ffi,Ff2\t = (/i,/2)t, {Qgx,Qg2)t = \gu92\t, 

for ft, faeV and g Xl g 2 E F. 

Proof. The proof is straightforward using the orthogonality relations for the nonsymmetric Wilson 
polynomials, see Theorems 15.81 and 15.111 □ 

The affine Weyl group W has an action on F defined by 

(«>/)(-7a) = /(-7™-i.a), wew, feF. 

We now define an action of Ti. a on F. For / 6 F and Z € 7i CT we set 
(5-5) (Z/)( 7 ) = (Z7)(7)- 

Here / denotes an arbitrary function / : C" — > C such that 7(7) = 7(7) for any 7 € Spec(— Y), 
and the action of Ha- on the right hand side is given by the usual difference- reflection operators. 
We need to verify that (|5.5[) is well-defined. 



Lemma 5.13. The action ofTL a on F defined by (|5.5|) is independent of the choice of extension 

7 off. 

Proof. It is enough to verify that the lemma is true for generators T?, is [0, n], and X;, i £ [1, n], 
of the algebra Tt a - For the Xj's this is obvious. Let f £ F and let / be an extensions of /. By 
Lemma 14.101 we have (sif)(-f) = (sj/)(7) for 7 £ Spec(— Y) and i G [0, n]. For the T^'s this gives 
us 

(777)(7) = Xi/(7) + (7)((«i/)(7) ~ /(7)), 
for any extension / of /. This is clearly independent of the choice of extension. □ 

We have the following intertwining properties for the Fourier transforms T and Q . 
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Proposition 5.14. The Fourier transforms T : V — > F and Q : F — > V have the following 
intertwining properties: 

To Z = a(Z) o T, ZeH, 

goz = a a {z)og, zeH a . 

Proof. It is enough to check the intertwining property of T for the generators Yi, Tj, U n , i G [1, n], 
of the algebra 7Y. This can be done using Lemma [5771 Proposition 15.41 and Proposition ^. Ill 

The intertwining property of Q follows from the intertwining property of T and Theorem 15. 121 
Let g G F, then g = J-f for a unique / £ P, or equivalently / = Qg. Let Z G Ho-, then 
Zg = T{a a {Z)f), which gives us 

Q{Zg) = {Q o T){o a {Z)f) = a a (Z)f = o a {Z)Qg. □ 

6. Symmetric multivariable Wilson polynomials 

In this section we define and study symmetric multivariable Wilson polynomials. They turn 
out to coincide with the multivariable Wilson polynomials as defined by Van Diejen [3]. In [1] it is 
shown that the symmetric Wilson polynomials in n variables diagonalize a system of n commuting 
difference operators, the duality property is obtained, and orthogonality relations are given. We 
derive these properties here from the representation theory of the rational DAHA Tt, and we 
provide the link with the nonsymmetric theory. 

6.1. Symmetric Wilson polynomials. For A G A + we define 

T(\) Wo =v{x)nr Wo . 

Observe that it follows from V = © AeA+ V(X) that T w ° = AeA+ V(\) w °. 

Proposition 6.1. For A G A + the space V (A) w ° is one-dimensional. Furthermore, any f G 
V(X) W ° is given by 

(6-1) /= E d A,„£(-,7M)» 

with 

^A,/i = dxc+(-~f^), 
for some constant d\ independent of fi G Wo A. 

Proof. Let i G [l,7i]. From Proposition 15.41 we know that 

(Ti - Xi)E(-,^) = c^(-7 p )(^(-,7«m) " £ (-.7^)), 
if Sifj, ^ /i. Applying (Tj — Xi) to the expansion (|6.ip and using (Tj — Xi)f = we find a recurrence 
relation for the coefficients d\ jfl ; 

(6-2) d x , ai , = £^d^. 

Here we also used c a (j SilJl ) = (sjC Q )(7 Al ) = 0^0(7^). Let • • • Si r be a reduced expression for 
(defined in the beginning of subsection 14. 2p . and define 

PI a ii ; Pj — ' ' ' s j — 2, . . . , r, 

then iterating (|6.2|) gives 

From the definition of c+(x) we see that (sjC+)(x) = c+(x)c_ ai (— x)/c ai {— x), and then 

, , Kc+)(~7a) , <(-7m) 

c+(-7a) c+(-7a) 
If we now set rfA.A = <^ac+(— 7a)> the lemma follows. □ 
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In Section 16751 we give an operator that maps V{\) onto 'P(A) 



w„ 



Definition 6.2. For A G A + we define the symmetric multivariable Wilson polynomial E + (x,j\) 
to be the unique polynomial in V(X) W ° that takes the value 1 at x — xq. 

Since f(xo) = /(— xo) if / € p w ° and E(—xo,j\) = 1, by Proposition ^ . 1 1 the symmetric Wilson 
polynomial E + (-,j\) is the polynomial in V(X) W ° with constant d\ given by 

dx = ( E c +(~7,)) ■ 

This constant can be evaluated with the following result. 

Lemma 6.3. The function K = ^2 weW wc + is a constant function, and 

K(x)= E c +{~ x u) = c +(~ x o), 

for any A G A + . 

Proof. We define the polynomial m by 

n 

m(x) = J] a(x) = (-2)" II {4~^)\{ x r 

a£S- l<j<fe<n j=l 

This is an anti-symmetric polynomial, i.e., (wm)(x) = (~l) l ^ w ^m(x) for any w G Wo, where l(w) 
denotes the length of w. It is well known that any anti-symmetric polynomial is the product of m 
with a symmetric polynomial. The product m(x)K(x) is manifestly an anti-symmetric polynomial; 

m(x)K(x)= J2 (-l)' (lu) w( II (t + Xk-XjXt-Xk-x^flia-x^b-Xj)). 

weW \ \<j<k<n j=l / 

Expanding both mix) and m(x)K(x) in monomials x^, \i € Z™ , we see that any monomial with 
nonzero coefficient in the expansion of m(x)K(x) also has nonzero coefficient in the expansion of 
m(x), hence K(x) is a constant. Now let A G A + , then by Lemma ^.lOl 

K(x) = K(-xx) = 22 (wc+)(-x\) = 2J c+(-%w\) + 22 (wc+)(-x\). 

»)6ffo w£Wo wdWo 

wX^X wX= X 

Consider a term (wc+)(—x\) with w ^ 1 from the second sum. There exists a simple root a,, 
i G such that a = w~ 1 a.i G £ _ . Then we see that the factor (wc a )(- xa) = c ai {—x\) equals 

zero, since ai(x\) = t for i G [l,n — 1] and ci„(xa) = 2t fl + 2u n . This shows that 

K{x) = E c +(-^)- 

In particular, for A = this gives K(x) — c + (—xq). □ 

6.2. Orthogonality relations. Next we show that the symmetric Wilson polynomials are or- 
thogonal with respect to (•, First a useful lemma. Let G W be the primitive idempotent 

where |W | = 2"n! is the cardinality of the finite Weyl group Wq. Note that V + f = / if / G T 5 ^ . 
Lemma 6.4. For f,g £ V w ° we have 

it v M-go) + 
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Proof. First note that st, i £ is symmetric with respect to (•, •)^~, since s^A + = A + , hence 

so is V + . Let f,g£ V w ° , then by Lemma[ 



(f,9)t = (V + f,g)t = (V + f,c + g)t = (f,V + (c + g)) + = (f,(V + c + )g) + = !±Lj*l{f,g)+. 

This proves the lemma. □ 

Theorem 6.5. The symmetric Wilson polynomials E + (-,"/\), A G A + , form an orthogonal basis 
for V w ° with respect to (•, -)^~. 

Proof. Since V Wa = Q)xeA+ ^ (A) ^ ^ s c l ear that the symmetric Wilson polynomials form a 
basis for T> w ^ . From the orthogonality relations for the nonsymmetric Wilson polynomials and 
the definition of the symmetric Wilson polynomials, it follows that 

(£+(-, 7 A),£ + (-,7j)t = 0, A^/i. 

Now the orthogonality with respect (•, •)£ follows from Lemma HTH □ 



6.3. Difference equations. A difference-reflection operator D £ V^ a (considered as a subalge- 
bra of End('P)) is of the form 

D = ^ c\ >w (x)t(X)w, 

with c\ jW (x) £ <C(x). Restricted to the algebra of Wo-invariant polynomials, it becomes a difference 
operator which we denote by D sym ; 

Dsym = ^ C X , w {x)t(X). 
AeA,toGW 

Moreover, D sym is Wo-invariant, i.e., w o D sym o w^ 1 = D sym for any w £ Wq. Together with 
Theorem 14 . 1 71 this leads to the following property of the symmetric Wilson polynomials. 

Theorem 6.6. The symmetric Wilson polynomials satisfy the difference equation 
f{Y) sym E + {-, lx ) = /( 7 a)£+(-,7a), A G A+, 

for any f £ V w ° . 

In particular, the symmetric Wilson polynomials are eigenfunctions of the following explicit 
difference operator. 

Proposition 6.7. The symmetric Wilson polynomials E + (-,j\), A G A + . are eigenfunctions of 
the second order difference operator L defined by 

n 

L = Y / A i {x)(r(e i ) - l) + A^-x) (r(- £i ) - f), 
i=l 

^ ^ _ (a + Xj)(b + Xj)(c + Xj)(d + Xj) -q (t + Xj + xj)(t + x t - xj) 
for eigenvalue J^ILi (\ + + ^ + c + d — 1 + 2(n — i)t) . 

Proof. Let f 2 G V w ° be defined by f 2 {x) = £™ =1 xf. We show that L = (f 2 (Y) - / 2 ( 7o )) \ sym . 
Then by Theorem 14. 1 71 the symmetric Wilson polynomials Tv + (-,7a) are eigenfunctions of L for 
eigenvalue Y^iilx = J2i A* (A* + which is precisely the eigenvalue in the proposition. 

Recall the reduced expression (|2.ip for r(ej), and recall that WT(ei)w^ 1 = r{wei) for u> G Wo- 
From the explicit expression for the F-operators we see that expressed in terms of the generators 
Tj contains only terms in which To occurs at most once (in the terms in which To occurs twice, 
the To's vanish using the quadratic relations in Ti). Hence L is of the form 

n 

C{x) + A i (x)r(e 4 ) + B^ri-e,) 
i=i 
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with Ai(x), Bi(x), C(x) £ C(x). Since Y{1 — 70,1 and therefore LI — 0, we see immediately that 
C(x) — — '}2 i {Ai(x) + Bi{x)). By the Wo-invariance of L the coefficients A{ and Bi must satisfy 

s et - ej Ai(x) = Aj(x), s 2 t i A i {x) = B l (x). 

Now it is enough to find the coefficient A\(x) of r(ei). We write 

n 

(6.3) E F * 2 = E c ^ w ' 

i=l wGW 

with c w (x) € C(x) and every w 6 W occurring in this expansion is an ordered subword of 

SiS i+ i ■ ■ ■ s n s n -i ■ ■ ■ s si ■ ■ ■ Si-i or Si_iSi_ 2 • • • s a si ■ ■ ■ s„s„_i 

for i G [1, n]. If we write here sq = s\ ■ ■ ■ s n ■ ■ ■ Sir(ei), and we use ur{ei) = r(uei)u, u G Wo, to 
write every k; in (|6.3[) as r(±£j)i; for some i> € VFq, then we see that r(ei) occurs only once. The 
only contribution to r(ei) comes from the expression T% ■ ■ ■ T n ■ ■ -Tq in Y±, and this gives us 

Ai(x) = c £l _ £2 (x) ■ ■ •c £l _ e „(x)c 2ei (x)c ei+e „ ■ ■■c ei+e2 (x)cs+2e 1 (x). 

Now the result follows from writing out this expression. □ 

Remark 6.8. It can be shown that the difference operator L acts triangularly with respect to the 
dominance ordering on the Wo-symmetric monomial mx = S^es a x ^ £ A + ; 

Lm\ = j x m x + E c A^ m M> 

/j<A 

with 7^ the eigenvalue from Proposition 16.71 This shows that the eigenspace of L for eigenvalue 
7^ is one-dimensional. The multivariable Wilson polynomials defined by Van Diejen [3J, [J, are 
eigenf unctions of L for eigenvalue 7^", hence they coincide with our symmetric Wilson polynomials. 

6.4. Duality. Using f(Y)E+(-,j x ) = /(7a)# + (-,7a) for / G V Wo , the duality property for the 
symmetric Wilson polynomials can be obtained in the same way as for the nonsymmetric ones, 
see Theorem 15.31 

Theorem 6.9. For A, /1 e A + . we have 

E+(x tl , lx )=E+( 1Xl x tl ). 

Using the duality property, the difference equations from Theorem 16.61 give rise to recurrence 
relations for the symmetric Wilson polynomials. 

6.5. The symmetrizer. We define an operator C + : C(x) — » C(x) by 

C+ = V+c + (X), 

where c+(X) is multiplication by c+(x), see (|5.3p . We call C + the symmetrizer. 

Lemma 6.10. The symmetrizer C + has the following properties: 

(1) For f eV we have C+ f G V w ° . 
(ii) For f G V Wo we have C+f = iWbl -1 ^ (-se )/. 
(Hi) For i G [1, n], C+T t = Xl C+ = T,C+ . 

Proof, (i) Let us denote |Wo|(C + /)(x) = Kf(x). In the same way as in the proof of Lemma \G. 31 
we find that the product m(x)Kf(x) is an anti-symmetric polynomial, from which it follows that 
K f £V w °. 

(ii) If / £ T> w ° we see that Kf — fK\. Then the result follows from Lemma 1^731 

(iii) Let i € [l,ra]. Using T t = Xi + c l (X)(s i - I) and c ai + c_ a; = 2\i we find Tj + %i = 
{si + l)c_ ai (X), since SiC ai = c Siai - Furthermore, from the definition of c+(x) it follows that 
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s lC+ (X)c ai (X) = c + (X)s i C- ai (X). This gives 

C + (T t + Xi ) = V + c + {X) Sl c- at (X) + V + c+(X)c^ ai (X) 
= V + Sl c + {X)c at {X) + V + c + {X)c_ ai {X) 
= V + c + (X)2 Xi 
= 2 Xi C + , 

since V+s, = V+. This proves the identity C+T, = x;C+. The identity TiC+ = XiC + follows 
from (i), since TJ = Xif for / G V w ° . □ 

We show that the symmetrizer C + maps V(X) onto P(X) W ° for all A G A + . 

Proposition 6.11. For A G A + and /i G WqX, we have 

Proof. Let A G A+ and \i G Wo A. We know that C + £(-, 7At ) G V w ", so by Theorem IB"31 there 
exists an expansion 

C + E(-, 7fl ) = b^E + {-, lv ). 

Using the orthogonality we find 

b^ u {E+(; 7v ),E+(; 7u ))+ = (E+(; 7u ),C + E(; 7ll )) + 
(6.4) = (V+E+(;^),C + (x)E(;^)) + 

= (E+(; 1 „),E(;^))) t . 

Since E + (-, 7 „) G V{v) w ° we obtain from the orthogonality relations for the nonsymmetric Wilson 
polynomials that b^ v = if fi Wqv, i.e., if v ^ A. We can find S^a by evaluating at ieo- Using 
(wc + )(—xo) = if w 7^ 1, we obtain 

(C+£7(., 7|i ))(a; ) = \Wo\- 1 (wc+)(-x )(wE(;^))(-x ) = |Wbj- 1 c + .(-x ). 

This proves the proposition. □ 

6.6. Quadratic norms. Next we derive the quadratic norms for the symmetric Wilson polyno- 
mials, see [U Theorem 7.4]. 

Theorem 6.12. For A G A+, 

(£+(•, 7A ),£+(-,7A)) t + = TT^r, 

N+( 7 a) 

w/iere 

/V r A - 1 C +(~7a) TT C-q(7A) 

7 (l 5 l)t + ^(-7o) I* c S ( 7A ) 

Proof. From (|6.4p and Theorem 15. Ill we obtain 

(E+(- r/x ),E+(; lx ))+ = J^l 7A ),£?(., 7A )) t 

c+(-x ) 

I Wo Idx A 



c+(-x )7V( 7A )' 

where d A ,A is the coefficient of E(-,-f\) in the expansion of £ ,+ (-, 7 a) from Proposition ^. 11 i.e. 

4(-7a) 



*A.A 



c^(-7o)' 

Writing out N(j\) and using Lemma |6"/31 gives the result. □ 
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